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INTRODUCTION 


The  Research  on  Operations-Limiting  Visual  Extinction  (RESOLVE)  project  is 
sponsored  by  the  Department  of  Defense  (DOD)  and  stems  from  a  concern  that 
visibility  in  the  areas  of  the  China  Lake  Naval  Weapons  Center  (NWC),  Edwards 
Air  Force  Base  (AFB),  and  Fort  Irwin  National  Training  Center  has  declined  over 
the  years  since  these  bases  were  established.  Since  NWC  and  Edwards  are  major  and 
unique  national  weapons  and  aircraft  test  areas  that  rely  on  optical  tracking  as 
part  of  the  test  process,  further  degradation  of  visibility  has  the  potential  to 
hamper  test  activities  affecting  national  security  (Reference  1). 

The  objectives  of  RESOLVE  are' 

•  To  understand  the  effect  of  present  air  pollution  sources  on  visibility 
in  the  testing  region  airspace  (R2508  airspace)  and  to  identify  the  major 
pollutant  sources  and  transport  routes  that  contribute  to  visibility 
degradation. 

•  To  determine  baseline  and  spatial  and  temporal  variability  and  trends 
for  atmospheric  visibility,  aerosol  characteristics,  and  related  meteorological 
parameters  in  the  study  area,  with  special  emphasis  on  selected  locations 
at  the  military  facilities. 

These  objectives  will  be  met  by  conducting  a  monitoring  program  in  the  study  area 
with  both  continuous  and  short-term  (special  study)  activities.  Continuous  moni¬ 
toring  began  in  1983  and  will  continue  into  1985.  The  data  collected  will  be 
analyzed  to  meet  the  above  objectives. 

(Quality  assurance  concerns  have  been  key  factors  in  planning  and  implementing 
Rl  SOLVE.  From  the  project’s  initial  conception,  decisions  have  been  guided  by  the 
requirements  of  many  aspects  of  quality  assurance.  These  aspects  included  (1) 
project  organization,  (2)  network  design  and  planning,  (3)  preliminary  equipment 
preparation  and  testing,  (4)  network  operation  (data  collection  and  processing), 
( 5  >  internal  quality  control,  and  (6)  external  audit  procedures. 

I  his  report  focuses  on  the  role  and  effect  of  quality  assurance  activities  in 
the  routine  monitoring  portion  of  the  project.  Data  recovery  statistics  for  the 
initial  10  months  of  operation  arc  presented,  along  with  precision  and  stability 
estimates  for  nephelometers  and  teleradiometers. 
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PROJECT  DESCRIPTION 
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ORGANIZATION 

The  organization  chart  (Figure  !)  indicates  the  roles  of  the  many  cooperating 
groups  and  interested  parties  participating  in  RESOLVE.  1)01)  lias  assigned  project 
coordination  to  NWC.  The  routine  monitoring  and  some  of  the  other  aspects  of 
RESOLVE  are  being  managed  by  the  Environmental  Protection  Agency's  (EPA) 
Environmental  Monitoring  Systems  Laboratory  in  Las  Vegas  (EMSL-LV).  Much  of  the 
actual  work  is  being  performed  by  EMSL-LV  or  1)01)  contractors,  subcontractors, 
and  consultants,  including  Lockheed  Engineering  and  Management  Services  Co..  Inc. 
(l.EMSCO).  the  University  of  California  at  Davis  (UCD).  Global  Geochemistry 
Corporation  (GGC),  Rockwell  International.  Sonoma  Technology,  Inc.,  and  Santa  l  e 
Research.  Inc. 


RESOLVE 

Organization 


FIGURE  1.  RESOLVE  Organization. 


A  key  feature  of  the  project  organization  is  the  broad  base  of  input  for 
decision  making.  NWC  has  provided  mechanisms  for  the  technical  consultants.  EPA, 
U(  I).  and  the  research  and  technical  community  in  general  to  be  involved  in 
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project  planning.  The  project  plan,  distributed  to  the  technical  community  for 
review  in  the  early  planning  stages  of  the  project,  received  numerous  comments  from 
the  technical  community  and  was  revised  accordingly.  While  the  study  is  in  process, 

NWC  plans  to  issue  a  series  of  reports  on  a  number  of  topics  including  preliminary 
data  analysis  results,  quality  assurance  and  standard  operating  procedures,  and 
synoptic  and  historical  meteorological  analyses,  among  others.  Q 


NETWORK  DESIGN  AND  PLANNING 

An  appreciation  of  the  geographic  and  air  pollution  characteristics  on  the 

project  area  (Figure  2)  is  important  to  understanding  the  monitoring  approach.  The 
southern  California  desert  area,  in  the  rain  shadow  of  the  Sierra  Nevada  and 

transverse  mountain  ranges,  consists  of  low  desert  valleys  separated  by  mountains. 

Mining,  tourism,  and  military  activities,  with  supporting  residential  and  commercial 
activities  centered  in  scattered  small  towns,  characterize  this  generally  unpopulated 
area.  Except  for  the  mining  and  tourism  mentioned,  the  area  has  few  local  air 
pollution  sources.  However,  due  to  their  proximity,  the  Los  Angeles  urban  area 

and  the  San  Joaquin  Valley  agricultural  and  industrial  areas  influence  visibility 
and  air  quality  in  the  R250X  airspace  (References  2  and  3).  The  mountains  that 
form  the  western  and  southern  borders  of  the  desert  serve  to  control  the  spread  of 
pollutants  from  these  areas.  Polluted  air  masses  must  How  through  the  passes  or  go 
over  the  mountain  tops  as  they  move  into  the  desert.  Land  to  the  north  and  east 
of  the  military  facilities  is  largely  vacant,  and  not  expected  to  be  a  source  of 
polluted  air  masses.  However,  dry  lakes  in  the  desert  regions  are  a  source  of  wind¬ 
blown  dust  and  can  contribute  to  localized  visibility  impairment  under  high  wind 
conditions. 

The  design  of  the  RESOLVE!  monitoring  network  is  compatible  both  with 
networks  proposed  by  the  California  Air  Resources  Board  (C'ARB)  and  to  the 
network  being  implemented  by  the  multi-organization  Subregional  Cooperative 
Electric  Utility.  National  Park  Service,  and  Environmental  Protection  Agency  Study 
(SCENES)  in  the  desert  southwest.  In  choosing  monitoring  station  locations,  study 
objectives,  siting  criteria,  and  budget  restrictions  were  considered.  Siting  criteria 
require  the  site  to  ,>c  ( 1  )  representative  of  an  area  a  minimum  of  20  to  30 
kilometers  in  radius.  (2)  either  source  or  receptor  oriented.  (3)  remote  from  local 
sources  of  particles,  (4)  on  good  access  roads,  and  (5)  near  commercial  power.  A 
total  of  eight  sites,  listed  in  Table  1,  and  shown  on  Figure  2,  were  selected.  Four 
of  these  China  Lake  NWC.  Randsburg  Wash  NWC.  Edwards  AFB,  and  Fort  Irwin 
are  considered  primary  sites  though  they  do  not  have  identical  instrumentation. 
The  four  primary,  receptor-oriented  sites  will  establish  baseline  visibility  for  the 
military  facilities.  Each  of  the  primary  sites  has  a  history  of  earlier  measurements. 
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FIGURE  2.  Map  of  RESOLVE  Stations. 
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TABLE  1.  RESOLVE  Monitoring  Stations  and  Equipment. 

Monitoring  stations 


Edwards 

AFB 

.  .  ,  Randsburg 

China  Lake  hurt  Big 

NWC  \\VC  IrU'n  Pin‘‘ 

Tehachapi  Soledad 
Pass  Pass 

Cajon 

Pass 

1 

I  111 

i  i 

i 

la 

1“ 

o 

1  3 

2 

1  1  .3 

i 

1  1  1 

1  1 

i  i 

i  j 
! 

Equipment 


Nephelometer  l  1  1111  1  I  S 

Heated  nephelometer  la  1 “  2 

Continuous  teleradiometer  2  1  3  fi 

Camera  2  1  1  .3  7 

RESOLVE  2x4  particle 

sampler^’  1  1  11  1  117 

Dichotomous  sampler  1  1  - 

DRl  particle  sampler  To  be  mused  between  sites  4 

Wind  speed,  wind  direction, 

temperature  1  1  1111  1  1  S 

Dewpoint  1111  4 

Relative  humidity  11  114 

Solar  radiation  1^  1^  2 

Satellite  data  system  1  1  11  1117 

Cassette  tape  data  ssstem  1111  4 

Strip  chart  recorders  1  I  113  1  1  1  10 

Radiosonde  (upper  air  wind 

speed,  wind  direction. 

temperature;  and  RHj  1^  2 

a  To  he  sw  itched  automatically  between  heated  and  ambient  temperature  inlets.  These  have  been  funded  and 
provided  to  the  study  bv  the  Western  Oil  and  Gas  Association  (WOGAl.  Planned  installation:  August  1984. 

2x4  refers  to  collection  in  two  size  ranges  of  a  total  of  4  simultaneous  samples  il  total,  d  <  It)  ^m:  .3  fine, 
d  <  2.3  mm 

'  Multistage  rotating  DRl  M  impactor. 

^  Not  collocated  with  monitoring  site.  Operated  bv  DOD  personnel. 


1  3 


The  other  tour  sites  are  secondary,  or  source-oriented,  with  three  located  in 
key  passes  and  one  in  the  northern  portion  of  the  R2508  airspace.  The  three  passes 
are  Tehachapi  Bass,  to  represent  airflow  from  San  Joaquin  Valley,  and  Soledad  and 
Cajon  Basses,  to  represent  the  airflows  from  the  Los  Angeles  basin.  Two  passes 
were  selected  to  characterize  the  Los  Angeles  urban  area  aerosols  because  of  the 
area’s  large  size  and  inhomogeneous  distribution  of  pollutant  sources.  In  contrast, 
the  southern  part  ol  the  San  Joaquin  Valley  contains  fewer  types  of  sources.  The 
purpose  of  the  Big  Bine  site  is  to  determine  visibility  conditions  and  particulate 
characteristics  in  the  northern  portion  of  the  R2508  airspace. 

EQUIPMENT.  PREPARATION.  AND  TESTING 

Table  I  lists  the  monitoring  equipment  operating  at  each  station.  All  sites 
have  nepheiometers.  RESOLVE  2x4  (a  collection  in  two  size  ranges  ot  a  total 
of  four  simultaneous  samples  (1  coarse.  <  10/um:  3  fine.  <  2.5/am))  or  Sierra 

dichotomous  particle  samplers,  and  meteorological  sensors.  The  receptor  sites  have  a 
second  means  of  monitoring  visibility,  i.e..  teleradiometer  and  or  camera.  A  number 
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ol  other  measurements  using  heated  nephelometers  ami  Davis  Rotating  Universal 
Multistage  (DRI!M)  samplers.  radiosondes,  anil  solar  radiometers  are  made  routinely 
at  seleeted  sites.  In  I  ehruary  ll)<S4.  DRUM  samplers  were  plaeed  at  Soledad. 
lehaehapi.  and  I  dwards.  The  fourth  one  will  he  used  for  speetal  studies  until  the 
fall  ol  1 9,54. 

State-of-the-art  satellite  telemetry  systems  are  used  to  process  the  continuous 
monitoring  data  at  each  site  to  hourly  averages  and  standard  deviations.  These 

piocesscd  data  .ire  available  and  updated  at  least  every  5  hours  through  the  National 
I  nvuonmental  Satellite  facilities.  The  choice  of  satellite  telemetry  as  the  main  data 
collection  system  with  a  cassette  tape  collection  system  as  hack  up  was  a  key 

decision  with  a  number  of  ramifications.  These  ramifications  include  (1)  data 

availability  for  review  by  a  project  scientist  the  day  after  they  are  collected.  (2) 

processing  of  data  at  stations  reducing  work  performed  by  data  personnel,  and  (3) 
collection  of  data  redundancy  minimizing  data  loss  caused  by  data  system  mal¬ 
function.  Recause  instrument  failures  can  he  detected  quickly,  and  a  (echiT  i 

to  remedy  the  situation,  data  recovery  is  improved. 

In  choosing  equipment,  the  desirable  qualities  of  standardization  among  :tes 
and  icliability  were  balanced  against  budget  and  equipment  on  hand  from  ,  ..ions 
studies.  In  a  number  of  cases,  instruments  were  modified  and  then  tested  extensively 
before  deployment  to  ensure  reliable  operation,  lot  example,  numerous  Meteorology 
Research.  Inc.  (MRI)  Model  1560  series  and  15‘>()  series  nephelometers  were  on 
hand  from  earlier  studies.  To  ensure  uniform  operating  characteristics,  all  were 
rebuilt  including  the  addition  of  10-turn  potentiometers  to  adjust  zero  and  gain 
and  a  mechanical  test  device  to  provide  a  reliable  check  of  instrument  drift  within 
the  normal  operating  range.  Modifications  to  the  teleradiometers  (MRI  model  3030) 
eliminated  data  loss  associated  with  filter  turret  wheel  failure.  These  modifications 
were  accomplished  by  anchoring  the  turret  wheel  so  that  only  the  green  filter 
<5'0  nanometers)  is  in  the  light  path.  In  addition,  baffles  were  installed  to  minimize 
flare. 

<  onsiderable  cllort  went  into  preparation  of  the  RISOI  VI  2x4  particle 
samplers  that  were  loutul  to  be  unreliable  in  initial  tests.  |  lie  2x4  is  a  newly 
desiened  sampler  that  uses  a  group  of  previously  well-tested  components.  The 
w  mi  I- 1  n  sc  its  1 1 1  v  e  l(f -micrometer  particle  diameter  inlet  systems  are  commercially 
available,  (yelones  provide  the  line  sample  (diameter  -  2.5  micrometers)  size  cut. 
\  total  ol  lour  samples  are  collected  simultaneously  for  each  sampling  period  in 
these  tvvo  si/e  ranges  (three  fine  samples  and  one  total  sample).  Multiple  fine 
samples  were  desired  to  provide  simultaneous  use  of  different  filter  materials  t o 
allow  lot  elemental  analysis  and  carbon  analysis,  a  ml  to  provide  a  duplicate  for 
quality  assurance  checking.  Removable  filter  cassettes  secure  the  filter  in  the 
sampleis  and  are  used  to  sit  ip  fillers  to  ami  from  the  field,  thus  minimizing 
contamination  resulting  from  handling  under  field  conditions.  I  he  sampler  is  designed 
to  operate  tor  up  to  nine  predetermined  sample  periods  by  rotating  unused  filters 
mb'  the  flow  system  file  sampler  uses  electronic  pressure  transducers  and  filter 
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position  indicators  to  measure  flow  and  filter  information  that  is  relayed  with 
other  data  via  satellite  telemetry  to  1  MSL-LV.  Particle  sampler  operating  status  is 
then  reviewed  with  other  data.  After  some  redesign  and  extensive  modifications, 
because  of  earlier  operational  problems,  the  seven  2x4  samplers  were  operated 
side-by-side  in  a  comparison  test  with  two  virtual  impactors  (Sierra  Instruments 
Model  244  Dichotomous  Sampler).  These  tests  were  used  to  evaluate  sampler  per¬ 
formance.  eliminate  defects,  develop  standard  operating  procedures,  and  develop 
precision  information.  A  report  that  discusses  the  intercomparison  results  in  detail 
is  in  preparation.  To  summarize,  mass  and  elemental  measurements  have  been  inter- 
compared  and  found  to  agree  satisfactorily,  typically  within  109?  for  the  total 
samples  and  within  1 2'f  for  the  fine  samples.  Plans  call  for  the  evaluation  of  the 
2x4  sampler  to  continue  in  the  field,  at  China  Lake  NWC.  where  the  2x4  sampler 
will  be  operated  routinely  side-by-side  witli  a  CARB-operated  dichotomous  sampler. 


NLTWORK  OPERATION 

With  the  exception  of  the  2x4  and  DRUM  particle  samplers,  network 
operations  began  in  August  1983.  The  stations  became  fully  operational  in  April 
1984  and  will  continue  operation  through  April  1985.  After  that  date,  operation 
of  the  stations  will  continue,  but  at  a  reduced  level  of  effort,  with  emphasis  on 
maintaining  high  data  recovery  at  the  primary  stations.  The  data  recovery  target 
is  909;.  computed  for  each  site  and  instrument  on  a  quarterly  basis.  The  primary 
stations  are  expected  to  continue  operating  indefinitely.  The  secondary  stations 
will  be  removed  when  they  are  no  longer  needed. 

With  the  exception  of  the  Big  Pine  site,  the  LMSL-LV  support  contractor, 
LI  MSCO.  is  responsible  for  the  routine  operation  of  the  monitoring  network.  This 
operation  includes  equipment  and  particle  sampler  servicing,  calibrations,  maintenance, 
repairs,  data  processing,  quality  control,  and  regular  reporting.  The  Big  Pine  site  is 
operated  by  Great  Basin  Unified  Air  Pollution  Control  District,  with  data  processing 

for  this  site  arranged  by  NWC.  Because  Big  Pine's  operation,  data  collection,  and 

data  processing  are  different  from  the  other  sites,  it  will  not  be  included  in  the 

discussions  that  follow. 

All  LI  MSCO  and  I  PA  personnel  assigned  to  this  project,  except  for  the  field 
operators,  are  located  in  Las  Vegas.  A  full-time  field  operator  is  responsible  for 
routine  servicing  and  maintenance  of  the  live  southernmost  stations.  A  part-time 
operator  maintains  the  China  Lake  and  Randsburg  Wash  stations. 

Ihe  chemical  analyses  being  performed  on  the  2x4  particle  samples  are 

described  in  fable  2.  Gravimetric  mass  is  determined  for  all  but  the  quartz  (carbon) 
analysis  substrate  filters.  I  very  third  day.  for  three  primary  sites,  the  total  2x4 

particle  samples  ami  one  of  the  fine  filters  are  analyzed  using  proton-induced  x-ray 

emissions  (PIXI  )  and  optical  absorption  (OAT).  Analyses  being  performed  for  other 

sites,  lor  the  DRUM  samples  and  the  methods  for  selecting  35  days  for  which  the 
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optical  analyses  arc  to  he  performed  are  discussed  elsewhere  ( Reference  ll.  U(  I) 
prepares  the  filters  for  elemental  and  mass  analysis  and  performs  particle  sample 
analysis.  ( ■( .(  prepares  the  quart/,  filters  and  performs  total  and  organic  earhon 
analyses.  I  he  samples  from  the  Big  I’ine  and  China  l  ake  dichotomous  samplers 
are  weighed  and  analyzed  hy  x-ray  fluorescence  (XR|;)  hv  (  ARB. 


I  ABI.l'.  2.  M.SOI.VK  2vl  Sampler  liltri  Analw-s. 
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INTERNAL  QUALITY  ASSURANCE 

Ouality  assurance  activities  are  described  in  documents  prepared  hy  the 
various  contractors.  J  I  M  SCO  is  responsible  for  monitoring  and  data  processing. 
M  l)  is  responsible  for  sample  analysis  for  gravimetric  mass  and  hy  PIXI  and  OAT. 
and  ( .( ■(  is  responsible  for  sample  analysis  for  total  and  organic  carbon. 

I  l-.MSCO  has  prepared  a  detailed  monitoring  quality  assurance  manual  including 
a  standard  operating  procedures  section.  Topics  of  discussion  include  instrument 
operational  checks,  calibrations,  zero  checks,  and  preventive  maintenance,  logs  and 
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other  forms  of  documen*  ‘ion:  chain  of  custody:  and  data  control  and  validation. 
LHMSCO  is  responsible  for  processing  data  to  engineering  units  and  providing 
statistical  and  graphic  summaries  of  the  data.  Data  traceability  and  the  validity 
of  computer  algorithms  are  also  discussed  in  the  quality  assurance  manual. 

Instrument  operational  checks  are  performed  on  a  weekly  basis.  Results  trom 
the  checks  are  compared  to  warning  and  control  limits  specified  lor  each  instrument 
type.  (These  values  typically  are  warning  ±3  to  10%  and  control  ±10  to  25%. 
depending  on  instrument  type.)  It  a  single  value  exceeds  the  warning  limit,  the 
instrument  is  adjusted.  If  two  consecutive  values  exceed  the  warning  limit  or  any 
value  exceeds  the  control  limit,  the  instrument  is  checked  for  malfunction  and 
calibrated,  and  data  are  invalidated  back  to  the  last  successful  check.  Summaries  of 
some  of  the  operational  checks  for  nephelometer  and  teleradiometer  are  presented 
in  the  results  section  of  this  report. 

bach  particle  sample  analysis  contractor  has  also  provided  a  detailed  analytical 
procedures  manual  including  a  quality  control  procedures  section.  Included  in  these 
manuals  are  discussions  of  the  following:  repeat  analyses,  laboratory  and  field  blanks, 
analysis-system  calibration,  filter  handling  and  storage  procedures  and  environment, 
logs  and  other  forms  of  documentation,  and  data  control  and  validation.  Analysis 
contractors  will  process  data  to  engineering  units.  The  elemental  and  gravimetric 

analysis  contractor  (U('D)  also  provides  statistical  and  graphic  summaries  of  these 
data;  EMSL-LV  provides  these  data  for  the  other  particle  analysis  data.  The  respon¬ 
sible  organizations  have  prepared  procedures  that  allow  evaluation  of  data  trace- 

ability  and  the  validity  of  computer  algorithms. 

IK'D  has  performed  elemental  analysis  by  x-ray  methods,  primarily  by  PIXE 
but  including  XRE  since  1973.  Of  key  importance  is  how  to  ensure  that  the  quoted 

value  for  any  element,  sodium  or  heavier,  can  be  traced  back  to  an  adequate  stan¬ 

dard.  The  process  used  has  three  components: 

1.  System  Design.  From  the  published  values  of  x-ray  cross  sections,  the 
areal  density  of  elements  can  be  established  to  ±15%. 

2.  System  Calibration.  Thirty-two  elements  are  available  commercially  in  thin, 
weighed  foils  for  calibration.  Ten  of  these  are  analyzed  in  each  run. 
calibrating  the  system  to  within  ±15%.  Calibration  to  many  standards 
reduces  this  to  ±3%.  absolute. 

3.  System  Verifications.  (The  numbers  in  parentheses  give  the  number  of 
samples  involved  in  the  last  year.) 

a.  Internal 

(I)  Comparison  with  National  Bureau  of  Standards  and  U.S.  Geological 
Survey  standards  (20) 
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(2)  1*1X1-  to  XRT  comparisons  (21). 

(3)  Comparison  of  same  sample  run  cadi  month  (’(Mil 

(4)  Sum  of  all  elements  versus  mass  (including  II.  (  .  ami  Ol  (45) 

(5)  Comparison  ol  same  sample  run  repeatedly  (50). 

b.  External 

(1)  Informal  intereomparisons  (i.e..  analytical  and  chemical)  (40). 

(2)  Formal  third  party  (i.e..  Rockwell)  (40). 

(5)  Published  studies  (x-ray  spectrometer.  FPA/Dcpartment  of  Fnergy. 
Visibility  Impairment  due  to  Sulphur  Transport  and  Transformation 
in  the  atmosphere)  (36). 

In  summary,  over  the  past  decade,  an  absolute  accuracy  to  ±6 '/<  over  42 

elements  has  been  achieved. 

Determination  of  the  gravimetric  mass  of  samples  collected  on  filters  is  non¬ 
trivial  because  it  involves  the  comparison  of  pre-  and  post-weights  differing  by  only 
a  few  percent.  This  difference  is  particularly  true  when  the  pre-  and  post- 

measurements  occur  30  days  apart  (at  UC'D),  and  mass  loadings  in  clean  regions  of 

the  West  often  go  below  I  gg/iu-^  for  the  sub-2.5  micrometer  size  range. 

UCI)  has  developed  an  extensive  22-step  protocol  from  filter  manufacture  to 

archiving  samples,  including  three  electrostatic  de-excitations,  2-week  mechanical 

relaxations,  and  other  innovative  techniques  described  in  detail  in  the  UCD  quality 
assurance  manual  and  summarized  elsewhere  (Reference  4).  About  3500  tests  were 
performed  in  the  past  3  years  as  part  of  these  protocols  (14'/  of  all  samples), 
showing  the  following  precisions  in  weighing. 

Nuclepore  X.O  micrometer  (apiezon  coated), 

47-millimeter  diameter  0.0+5. 7  microgram 

Nuclepore  0.3  micrometer  (uncoaled). 

47-millimeter  diameter  0. 2+6.0  microgram 

lellon  3.0  micrometer  (ringed), 

25-millimeter  diameter  0.7+3. 7  microgram 

I  liese  average  to  lie  about  0.0012%  of  the  mass  of  the  blank  filter. 

EXTERNAL  QUALITY  ASSURANCE 

I  he  purpose  of  an  external  audit  program  is  to  provide  an  independent  check 
on  the  adequacy  of  equipment,  supplies,  personnel,  and  procedures:  to  evaluate  the 
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degree  to  which  procedures  are  followed:  and  to  provide  an  opportunity  for 
remedial  action  when  problems  are  identified.  Rockwell  International  will  perform 
five  field  audits  for  the  seven  southernmost  sites  and  laboratory  and  overall  system 
audits  for  LEMSCO,  UCD,  and  GGC  during  the  course  of  RESOLVE.  Activities 
performed  by  Rockwell  include  sampler  How  audits,  calibrations,  filter  analysis 
audits,  inspection  of  logs  and  other  documents,  review  of  procedures,  and  interviews 
of  personnel.  Details  of  these  activities  are  discussed  in  Rockwell’s  audit  protocols. 
Results  from  these  activities  are  summarized  in  audit  reports.  For  the  first  field 
audit,  the  mean  percent  difference  for  nephelometer  accuracies  at  the  seven  sites 
was  1  /?.  The  teleradiometer  mean  percent  difference  for  apparent  contrast  was 
- 1 6',f .  Results  from  the  subsequent  audits  are  not  yet  available. 


RESULTS 


Results  of  operational  checks  for  nephelometer  and  teleradiometer  are 
presented  in  this  section.  In  the  case  of  the  nephelometer,  the  operational  checks 
are  analogous  to  determining  precision  by  making  repeated  measurements  of  a 
standard  of  fixed  value.  Percent  precision  and  accuracy  arc  defined  similarly  using 
the  equation 

Precision  (or  Accuracy)  =  [(Yj  -  Xj)/Xj]  X  100 


where 


Yj  =  indicated  value  from  ith  check 

Xj  =  known  value  of  check 

l  or  precision  determination,  the  standards  (clean  air  and  Freon-12)  may  be  the 
same  as  used  in  the  calibration  process.  For  an  accuracy  determination,  the  standard 
must  be  different  from  that  used  in  the  routine  calibration  (Freon-12  for  the 
RESOLVE  nephelometers).  Thus.  Freon-22  or  a  second  bottle  of  Freon-12  and 
ideally  a  person  other  than  the  regular  station  operator  would  be  used  to  establish 
nephelometer  accuracy.  It  is  not  always  practical  to  determine  accuracy  with 
separate  personnel.  However,  Freon-22  is  used  routinely  to  check  the  performance 
of  the  RESOLVE  nephelometers.  This  procedure  has  been  termed  a  Freon-22 
accuracy  check. 

Figures  3,  4,  and  5  are  plots  of  the  mean  and  standard  deviation  of  precision 
(or  accuracy)  calculated  seasonally  for  each  site  for  nephelometer-measured  filtered 
clean  air.  Freon- 12,  and  Freon-22.  The  precision  values  are  determined  for  periods 
of  valid  data  only.  In  addition,  outliers  were  identified  by  Chauvenet’s  criterion 
and  removed  to  avoid  errors  caused  by  transcription  on  other  non-instrument-related 
problems.  Clean  air  mean  precisions  (Figure  3)  have  a  positive  bias  of  3  to  4 G, 
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with  i y picul  standard  deviations  of  about  5'<\  lor  I  icon- 1  2  (figure  4)  there  is 
vii  Hulls  no  bias  overall  w  ith  standard  deviations  ranging  from  I  to  nearly  S 
but  tv  pie. illy  less  than  S',.  I  here  is  a  negative  bias  ol  approximately  S',  loi 

I  iron  JJ  (figure  Si  with  standard  deviations  ranging  Irom  I  to  12',,  though 
typically  less  than  >'».  In  many  seasons,  only  one  Ireon- 2  2  cheek  was  perldnued 
at  each  site  (indicated  on  the  graphs  by  a  dot  only) 

I  hese  data  indicate  that  the  nephelomelers  lend  to  slightly  overestimate 
scattering  coefficient  (by  d  to  4'i)  when  it  is  near  Rayleigh  conditions,  and  that 
for  conditions  of  high  scattering  coefficient  there  is  little  bias  <  i.e. .  excellent 

repeatability  on  a  week-to-week  basis)  overall  Since  data  of  most  interest  in 
K1SOI  VI  are  for  days  with  visibilities  ranging  Irom  average  to  highly  impaired, 
these  precision  values  aie  satisfactory.  The  accuracy  data  indicate  a  tendency  to 
underestimate  scattering  coefficients  by  approximately  8 'j  for  days  of  somewhat 

worse  than  average  visibility,  but  this  tendency  is  nearly  uniform  on  a  site-to-site 
basis.  I  hus.  though  times  of  somewhat-worse-than-average  visibility  are  underestimated 
slightly,  variability  from  site  to  site  is  not  large.  This  variability  is  consistent  with 

Rockwell's  audit  results  mentioned  earlier. 


FIGURE  3.  Nephelometer  Precision  Based  on  Clean  Air. 
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FIGURE  6.  Teleradiometer  Ratio  Test  Results. 

A  true  precision  check  lor  a  teleradiometer  is  not  easily  accomplished  in  the 
field,  so  a  substitute  has  been  devised  using  identical  sets  of  white  and  gray  cards 
at  two  of  the  teleradiometer  sites.  Approximately  every  month,  each  of  the  cards 
in  turn  is  placed  in  front  of  the  teleradiometers  and  radiance  values  recorded.  Since 
lighting  conditions  vary  each  time  the  cards  are  used,  the  absolute  radiances  vary. 
However,  the  ratio  of  the  radiances  is  expected  to  remain  constant.  Mean  ratios 
and  standard  deviations  lor  five  teleradiomcters  and  three  seasons  available  are 
shown  in  f  igure  6.  The  ratios  vary  from  0.275  to  0.550  with  typical  values  of  0.5 

and  standard  deviations  of  approximately  I0'f  of  this  value.  While  it  does  not 

provide  an  estimate  of  precision  or  accuracy,  this  technique  does  indicate  gross 

changes  in  teleradiometer  performance,  both  from  month  to  month  and  from 
site  to  site. 

A  simple,  overall  measure  of  the  internal  comparability  of  the  fine  particle 
samples  collected  by  the  2x4  samplers  is  determined  by  comparing  the 
gravimetrically  measured  mass  routinely  analyzed  on  two  of  the  three  fine  samples. 

Correlation  analysis  of  the  fine  mass  measured  on  the  two  samples  for  each  of  the 
seven  samplers  for  the  first  2  months  of  operation  results  in  a  mean  correlation 
coefficient,  r.  of  0.95  with  a  range  from  r  =  0.90  to  r  =  1.00.  Thus,  the  simul¬ 
taneous  fine  samples  are  highly  correlated  as  desired. 
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Percent  data  recovery  is  an  index  that,  when  used  in  context  with  precision 
and  accuracy  data  and  data  validation  procedures,  can  he  used  to  quantity  the 
overall  success  of  a  measurement  program.  Prevent  data  recovery  lor  a  continuous 
instrument  is  computed  monthly  In  dividing  the  number  of  va lid  hourly  averages  by 
the  total  number  of  hours  in  the  month  and  multiplying  by  100  l  or  teleradiometer 
data,  measured  during  X  daylight  hours  only  (0X00  to  l(>00  inclusive),  data  recovery 
is  computed  m  the  same  manner,  but  using  daylight  measurement  hours  rather  than 
all  hours,  for  particle  samples,  collected  on  a  daily  basis,  data  recovery  is  calculated 
similarly  based  on  the  total  number  of  days  in  a  month.  A  summary  of  data 
recovery  values  for  the  first  10  months  of  R1  SOI. VP  is  presented  in  Table  3. 
The  values  represent  the  10-month  averages  for  each  site  by  parameter,  for  each 
site  overall,  and  for  each  parameter  overall.  A  review  of  the  data  recovery  values 
shows  them  to  be  generally  better  than  9071  with  the  grand  average  of  all  parameters 
and  all  sites  at  9 1 These  high-data  recovery  values  are  attributed  to  thorough 
quality  control  and  the  use  of  satellite  telemetry  with  rapid  data  review.  At 
Tehachapi.  the  site  with  the  lowest  data  recovery  (X4':?),  the  reduced  data  recovery 
is  attribute'll  to  unusually  high  winds  blowing  the  meteorological  tower  over  on  two 
occasions.  The  tower  anchors  have  since  been  redesigned.  The  DRUM  particle 
sampler  is  unique  among  the  instruments  listed,  as  it  is  the  only  one  not  incorpo¬ 
rated  in  the  satellite  telemetry  system.  The  data  recoveries  for  the  DRUM  samplers 
are  the  lowest  at  HU'!.  The  cause  of  this  low-data  recovery  is  attributed  to  the  lack 
of  sullicient  replacement  drum  substrates  immediately  alter  deployment  and  the 
problem  has  since  been  remedied.  Thus,  future  DRUM  data  recoveries  are  expected 
to  approach  90  to  100'-  because  the  sampler  has  proven  to  be  easy  to  operate, 
reliable,  and  rugged. 


TABI.K  i.  HI. SOI. \  Is  Percent  Data  Recovers  In  Instrument  and  Station 
lor  August  19K.3  Through  Mas  ItfSl. 
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SUMMARY  AND  CONCLUSIONS 


(duality  assurance  has  been  of  prime  concern  lor  the  Rl  SOLVI  monitoring 
program  Irom  ils  inception  througli  each  stage  of  the  program.  Instruments  were 
selected,  ami  m  some  cases  mollified  and  tested,  will)  the  goal  of  achieving  reliable 
measurements  with  high-data  recovery.  In  particular,  the  primary  data  recording 
system  operates  by  transmitting  data  values  via  satellite  many  times  daily  to  the 
project's  main  computer  facilities.  Phis  prompt  availability  allows  preliminary  review 
of  the  previous  day's  data  for  instrument  malfunctions.  Thus  far.  this  monitoring 
design  has  resulted  in  better  than  90 7>  data  recovery. 

I tensive  operations  and  quality  control  procedure  documents  were  prepared 
and  are  being  followed  for  every  phase  of  the  program.  These  include  numerous 
performance  checking  procedures,  the  results  of  which,  in  most  cases,  can  be 
interpreted  in  terms  of  precision  and  accuracy.  Preliminary  results  of  such  tests  for 
the  ncphelometer  indicate  results  with  precision  and  accuracy  of  better  than  10,;. 
Teleradiometer  measurements  of  contrast  show  variability  of  approximately  10'i. 
Overall  accuracy  for  elemental  analysis  of  particle  samples  is  generally  better  than 
10''.  as  is  gravimetrically  determined  mass  on  filter  samples. 

Much  remains  to  be  accomplished  with  regard  to  assessing  the  overall  precision 
and  accmacy  ol  values  measured  by  this  program.  Ihe  results  of  How  audits  must 
be  incorporated  into  the  sampling  precision  estimates  for  particle-related  measure¬ 
ments.  Where  feasible.  Ihe  bias  associated  with  accuracy  checks  can  be  used  to 
adjust  data  values,  finally,  further  quality  control  and  external  quality  assurance 
audit  results  must  be  compiled  and  evaluated. 
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